SYSTEM AND METHOD FOR USER-TO-USER COMMUNICATION VIA 
NETWORK 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a user-to-user communication system and 
method via a network, in particular, by which communication among users participating 
in a multi-user on-line game is smoothly executed in a narrow network bandwidth. 

2. Description of the Related Art 

Recently, development of the Internet uses computers by a rapidly growing 
amount, resulting in appearance of various fields and methods of off-line and on-line 
games. 

As development of the computer games rapidly progresses like this, 
competition among game developers is also gradually growing severe. Therefore, the 
game developers each are concentrating on schemes for maximizing interests of gamers. 

For example, the game developers diversify the computer games into Arcade 
Games, Simulation Games, Adventure games and the like to discriminate the kind of the 
games according to the inclination of the gamers. Also, the game developers are 
seriously considering those schemes to vary entire stories of the games by developing 
new scenarios for the games. 

In the games as above, a game server supports one-to-one or one-to-multi 
connections off-line or on-line, i.e., via the Internet so that the games can be executed. 

In order to allow a conversation or communication among the gamers 



participating in such a multi-user on-line game, the game has adopted methods in which 
a text data is transmitted/received using a keyboard after calling a counterpart or 
methods in which a compressed audio data is transmitted/received. 

When communication is executed among the gamers with the text data using 
5 the keyboard, there is barely a sufficient time to input the text data using the key board 
during the game, resulting in difficulty in communication. Recently, an increasing 

J=* number of gamers are gradually communicating with audio. However, since a network 

5 bandwidth for communication is narrow, the communication is mostly executed with 

, )i text but barely with audio . 
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Accordingly, the present invention has been devised to solve the foregoing 
problems and it is an object of the invention to provide a user-to-user communication 

15 system and method via a network, in particular, by which communication among users 
participating in a multi-user on-line game is smoothly executed with audio or text in a 
narrow network bandwidth. 

In accordance with an aspect of the invention to obtain the foregoing object, it 
is provided a user-to-user communication system via a network comprising: 

20 transmission means for recognizing a first audio signal which is inputted from a user, 
converting the first audio signal into a first text data, and transmitting the converted first 
text data, applied with a transmission code, into a counterpart terminal via the network; 
and receiving means for receiving a data applied with a transmission code from the 
counterpart terminal and converting the data into a second audio signal to output the 

25 same via a speaker. 



Preferably, the transmission means comprises: an audio recognition block for 
recognizing the first audio signal inputted from the user; a text converter block for 
converting the first audio signal recognized in the audio recognition block into the first 
text data; a data synthesizer block for synthesizing the converted first text data with a 
5 text transmission code; and a data transmission block for transmitting the first text data 
having the text transmission code synthesized thereto into the counterpart terminal via 
the network. 

Preferably, the transmission means further comprises: an audio compressing 
block for compressing the first audio signal from the audio recognition block into an 

10 audio data if the first audio signal is incompletely recognized; and a data synthesizer 
block for synthesizing the audio data compressed in the audio compressing block with 
an audio transmission code and transmitting the synthesized audio data into the 
counterpart terminal via the data transmission block. 

Also, it is preferred that the receiving means comprises: a data receiving block 

15 for receiving the data including the transmission code from the counterpart terminal; 
data separating means for judging the kind of the received data based upon the 
transmission code included therein to separate a second text data; and an audio signal 
converting block for converting the second text data, which is separated from the data 
separating means, into the second audio signal to output the same. 

20 It is preferred that the receiving means further comprises: a decompressing 

block for decompressing a compressed audio signal to output the same via the speaker if 
the received data is judged as the compressed audio data in the data separating means. 
Alternatively, the network may be a wire or wireless network. 

In accordance with another aspect of the invention to obtain the foregoing 

25 object, it is provided a user-to-user communication method via a network comprising 



the following steps of: recognizing a first audio signal inputted from a user; converting 
the recognized first audio signal into a first text data; synthesizing the converted first 
text data with a text transmission code; transmitting the first text data synthesized with 
the text transmission code into a counterpart terminal via the network and receiving a 
data including a transmission code from the counterpart terminal; judging the kind of 
the received data based upon the transmission code included therein to separate a 
second text data; and converting the separated second text data into a second audio 
signal to output the same via a speaker. 

Preferably, the user-to-user communication method further comprises the steps 
of: compressing the inputted first audio signal into a first audio data if the first audio 
signal is not recognized in the recognizing step; and transmitting the compressed first 
audio data into the counterpart terminal, synthesized with an audio transmission code. 

Preferably, if the received data is judged as a compressed audio data in the 
judging and separating step, the user-to-user communication method further comprises 
the step of: decompressing the compressed audio data to output the same via the speaker. 
Alternatively, the network may be a wire or wireless network. 

In accordance with a still another aspect of the invention to obtain the foregoing 
object, it is provided a digital processor-readable record medium including a realized 
program of command languages which can be executed by a digital processor for 
carrying out a user-to-user communication method via a network, wherein the program 
is executed in the following steps of: recognizing a first audio signal inputted from a 
user; converting the recognized first audio signal into a first text data; synthesizing the 
converted first text data with a text transmission code; transmitting the first text data 
synthesized with the text transmission code into a counterpart terminal via the network, 
and receiving a data including a transmission code from the counterpart terminal and 



judging the kind of the received data based upon the transmission code included therein 
to separate a second text data; and converting the separated second text data into a 
second audio signal to output the same via a speaker. 

BRIEF DESCRIPTION OF THE DRAWINGS 

In the following drawings: 

Fig. 1 schematically shows a structure of connection in a user-to-user 
communication system via a network in accordance with the invention; 

Fig. 2 is a detailed block diagram of the user-to-user communication system via 
a network in Fig. 1; 

Fig. 3 shows an operational flow chart for transmitting data in a user-to-user 
communication method via a network in accordance with the invention; and 

Fig. 4 shows an operational flow chart for receiving data in a user-to-user 
communication method via a network in accordance with the invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

The following detailed description will present a user-to-user communication 
system and method via network in accordance with preferred embodiments of the 
invention in reference to the accompanying drawings. 

Fig. 1 schematically shows a structure of connection in a user-to-user 
communication system via a network in accordance with the invention. 

As shown in Fig. 1, a user terminal 100 of the first user is connected to a user 
terminal 200 of the second user via the Internet. Each of the first and second user 



terminals 100 and 200 can be provided with a microphone for inputting an audio signal 
and a speaker for outputting the audio signal. 

During an on-line game proceeding between the two mutually connected user 
terminals, when the first user wants to have a conversation with the second user using 
5 the user terminal 100 via the Internet, the first user inputs an audio signal via a 
microphone mounted to the user terminal 100; and the first user terminal 100 recognizes 
the inputted audio signal of the first user, converts the recognized audio signal into a 
text data, and then transmits the text data into the second user terminal 200 via the 
Internet. 

10 The second user terminal 200 receives the text data transmitted from the first 

user terminal 100 via the Internet, converts the received text data into an audio signal, 
and then outputs the audio signal via a speaker. 

Data transmission between the user terminals is executed by converting the 
audio data into the text data rather than transmitting the audio data. Therefore, data 
15 transmission/receiving can be executed in an Internet bandwidth narrower than those 
required for common audio data transmission. 

Alternatively, when the audio signal inputted from the first user cannot be 
recognized, the inputted audio signal is compressed and then transmitted to the second 
user terminal 200 via the Internet. The second user terminal 200 decompresses the 
20 received audio data, and then outputs the decompressed audio data via the speaker. 

Such a transmission/receiving operation of data will be described in more detail 
in reference to Fig. 2. 

Fig. 2 is a detailed block diagram of the user-to-user communication system via 
a network in Fig. 1. 

25 As shown in Fig. 2, in the user-to-user communication system via a network, 



each of the user terminals 100 and 200 is comprised of a data transmission unit and a 
data-receiving unit. The data transmission unit includes an audio input block 110 for 
inputting an audio signal of a user; an audio recognition block 111 for recognizing the 
audio signal of the user inputted via the audio input block 1 10; an audio/text converter 
block 1 12 for converting the audio signal recognized in the audio recognition block 111 
into a text data; and an audio compressing block 1 14 for compressing the corresponding 
audio signal if the inputted audio signal is not completely recognized. Herein; the 
audio input block 110 can be constituted by a microphone. 

The data transmission unit further includes a transmission code storage block 
113 storing transmission codes for discriminating the audio data from the text data; a 
data synthesizer block 115 for synthesizing the audio data compressed in the audio 
compressing block 114 with an audio transmission code or synthesizing the text data 
converted in the audio/text converter block 112 with a text transmission code stored in 
the transmission code storage block 113; and a data transmission block 116 for 
transmitting a data synthesized in the data synthesizer block 115 into an terminal of 
another gamer or user, which is on-line connected, via the Internet. 

The data receiving unit includes a data receiving block 116 for receiving the 
data transmitted from the terminal of the corresponding gamer or user via the Internet; a 
data separator block 117 for analyzing the kind of the received data using the 
transmission code included in the data and then separating the corresponding data; a 
text/audio converter block 118 for converting the data separated in the data separator 
block 117 into an audio signal if the data is a text data; a decompressing block 119 for 
decompressing the data separated in the data separator block 117 if the data is a 
compressed audio data; and an audio output block 120 for outputting the audio signal 
decompressed in the decompressing block 119 or the audio data converted in the 



text/audio converter block 118 so as to be heard by the gamer. Herein, the audio 
output block 120 may be constituted by a speaker. 

Hereinafter it will be described about the operational principle of the 
user-to-user communication system via a network having the configuration set forth 
5 above in accordance with the invention. 

When one of the users or gamers wants to have a conversation with the 
counterpart during an on-line game proceeding among the users via the Internet, the 
user inputs an audio signal, which he/she wants to talk to the counterpart, via the audio 
input block 110. 

10 The audio signal inputted via the audio input block 110 is recognized in the 

audio recognition block 111, which provides the audio signal to the audio/text converter 
block 112 if the entire inputted audio signal is recognized. 

However, when the inputted audio signal is not completely recognized or an 
error takes place during recognition, the corresponding audio signal is sent to the audio 
15 compressing block 1 14. 

When the inputted audio signal is successfully recognized, the audio/text 
converter block 112 converts the audio data from the audio recognition block 111 into 
the text data, which is sent to the data synthesizer block 115. 

The data synthesizer block 115 outputs the text data converted in the audio/text 
20 converter block 112, synthesized with the text transmission code stored in the 
transmission code storage block 113, into the data transmission/receiving block 116, in 
which the text transmission code is inserted at the head of the text data or a character 
string. 

The data transmission/receiving block 116 transmits the text data, which has the 
25 text transmission code inserted thereto, from the data synthesizer block 115 into the 



terminal of the counterpart, which the first user wants to have a conversation with, via 
the Internet. The transmission into the counterpart terminal is executed via a server. 
The configuration of the server is not shown in the drawings. 

When the inputted audio signal is not recognized in the audio recognition block 
111 or an error takes place during recognition, the inputted audio signal is sent to the 
audio compressing block 114. 

The audio data compressed like this is sent to the data synthesizer block 115. 
The data synthesizer block 115 inserts the audio transmission code, which is stored in 
the transmission code storage block 113, into the compressed audio data, and then sends 
the compressed audio data into the transmission/receiving block 116. Therefore, the 
data transmission/receiving block 116 transmits the compressed audio data with the 
audio transmission code into the counterpart terminal, which the first user wants to have 
a conversation with, via the Internet. 

In sequence, hereinafter description will be made about the receiving operation 
when the first user terminal transmitted the text data or audio data in accordance with 
the method set forth above. 

When any data is received in the data transmission/receiving block 116 via the 
Internet, the data separator block 117 analyzes the transmission code included in the 
received data to judge whether the corresponding data is an audio data or a text data, 
and then separates the data. 

If the data separated in the data separator block 117 is a text data, the 
corresponding text data is converted into an audio signal in the text/audio converter 
block 118, and then the audio signal is outputted via the audio output block 120. 

If the data separated in the data separator block 1 17 is a compressed audio data, 
the compressed audio data is decompressed in the decompressing block 119, and a 



decompressed audio signal is outputted via the audio output block 120. In accordance 
with the data transmission/receiving method as set forth above, communication is 
carried out during a game proceeding among the gamers. 

Hereinafter description will be made step-by-step about a user-to-user 
5 communication method via a network in accordance with the invention corresponding 
to the user-to-user communication system via a network in accordance with the 
invention in reference to the accompanying drawings. The communication method 
will be divided into a data transmission method and a data receiving method in 
description thereof. 

10 Fig. 3 shows an operational flow chart for transmitting data in a user-to-user 

communication method via a network in accordance with the invention. 

First, during an on-line game proceeding among users via the Internet, when 
one of the users or gamers inputs an audio signal in order to have a conversation with a 
counterpart in SI 01, the inputted audio signal is recognized in S102. 
15 It is judged whether the inputted audio signal is completely recognized in SI 03, 

and if the inputted audio signal is completely recognized, the corresponding audio data 
is converted into a text data in SI 04. 

The converted text data is synthesized with a pre-stored text transmission code 
in SI 05, and then the text data having the synthesized transmission code is transmitted 
20 into the counterpart terminal via the network in S 1 06. 

If the inputted audio signal is not completely recognized or an error takes place 
in SI 03, the inputted audio data is compressed in SI 07. 

After a pre-stored audio transmission code is inserted into the compressed audio 
data in SI 08, the compressed audio data with the audio transmission code is transmitted 
25 into the counterpart terminal, which the first user wants to have a conversation with, via 



the Internet in SI 09. 

The foregoing process is summarized as follows: When the first gamer speaks 
during the game, the audio signal from the first gamer is recognized. If the audio 
recognition is complete, the audio signal is converted into the text without transmitting 
5 the audio signal. The text transmission code is inserted into the converted text data, 
and then the text transmission code is transmitted followed by transmission of the 
converted text data. If the audio recognition is not complete or a monosyllable word 
such as interjection which can be hardly recognized is inputted, the corresponding audio 
signal is compressed, and then the audio transmission code is inserted into the 
10 compressed audio signal. The inserted audio signal is first transmitted, followed by 
the compressed audio data. 

Fig. 4 shows an operational flow chart for receiving data in a user-to-user 
communication method via a network in accordance with the invention. 

If any data is transmitted from the counterpart terminal via the Internet as 
15 shown in Fig. 3, the terminal of the second user or gamer receives the corresponding 
data in S201. 

The received data is analyzed in S202, and then the transmission code included 
in the received data is analyzed to judge whether the received data is the compressed 
audio data in S203 . 

20 If the received data is judged as the text data instead of the compressed audio 

data, the corresponding text data is separated in S204, the separated text data is 
converted into the audio data in S205, and the converted audio data is outputted via the 
speaker S206. 

However, if the received data is judged as the compressed audio data in S203, 
25 the corresponding compressed data is separated in S207, and then the separated 



compressed audio data is decompressed in S208. The decompressed audio signal is 
outputted via the speaker in S206. 

In short, the transmission code included in the data, which is received via the 
network or Internet, is analyzed to judge whether the corresponding data is the audio or 
5 text data. If the corresponding data is the compressed audio data, the corresponding 
data is decompressed, and then the decompressed audio signal is outputted via the 
speaker. If the received data is the text data, the text data is converted into the audio 
signal, which is outputted via the speaker. 

In the user-to-user communication system and method via a network in 

10 accordance with the invention as set forth above, when one of the gamers speaks during 
the game, the audio signal of the first gamer is recognized. If audio recognition is 
complete, the audio signal is converted into the text data without transmission of the 
audio signal, and the text transmission code is inserted into the converted text data. 
The text transmission code is first transmitted, followed by the converted text data. If 

15 audio recognition is not complete or a monosyllable word such as interjection which is 
hardly recognized is inputted, the corresponding audio signal is compressed and the 
audio transmission code is inserted into the compressed audio signal. The inserted 
audio transmission code is first transmitted, followed by the compressed audio data. 

The transmission code included in the data, which is received via the network 

20 or Internet, is analyzed to judge whether the corresponding data is the audio data or the 
text data. If the received data is the audio data, the corresponding audio data is 
decompressed into the audio signal, which is outputted via the speaker. If the received 
data is the text data, the corresponding text data is converted into the audio signal, 
which is outputted via the speaker. 

25 Accordingly, when one of the gamers wants to have a conversation with the 



counterpart gamer during execution of the multi-user network game, the inputted audio 
signal is transmitted into the counterpart terminal, converted into the text data, and the 
counterpart terminal outputs the received text data after converting into the audio data. 
Therefore, there is an advantage that communication can be smoothly executed among 
the gamers even in the narrow network bandwidth. 
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